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Abstract. The paper analyzes a two-grid and a multigrid method for matrices 
belonging to the DCT-III algebra and generated by a polynomial symbol. The 
aim is to prove that the convergence rate of the considered multigrid method 
(V-cycle) is constant independent of the size of the given matrix. Numerical 
examples from differential and integral equations are considered to illustrate 
the claimed convergence properties. 
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1. Introduction 

In the last two decades, an intensive work has concerned the numerical solution 
of structured linear systems of large dimensions [6l 1141 1X6] . Many problems have 
been solved mainly by the use of (preconditioned) iterative solvers. However, in 
the multilevel setting, it has been proved that the most popular matrix algebra 
preconditioners cannot work in general (see [UJ HS1 HO] and references therein) . 
On the other hand, the multilevel structures often are the most interesting in 
practical applications. Therefore, quite recently, more attention has been focused 
(see [DI3|71|Sl|271l3[T3[ini[I3l21|53[I51)onthe multigrid solution of multilevel 
structured (Toeplitz, circulants, Hartley, sine (r class) and cosine algebras) linear 
systems in which the coefficient matrix is banded in a multilevel sense and positive 
definite. The reason is due to the fact that these techniques are very efficient, the 
total cost for reaching the solution within a preassigned accuracy being linear as 
the dimensions of the involved linear systems. 
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In this paper we deal with the case of matrices generated by a polynomial symbol 
and belonging to the DCT-III algebra. This kind of matrices appears in the solution 
of differential equations and integral equations, see for instance [3] [T5J [23]. In 
particular, they directly arise in certain image restoration problems or can be used 
as preconditioners for more complicated problems in the same field of application 

nam]. 

In a Two-Grid (TGM) /Multi-Grid (MGM) Method has been proposed 
and the theoretical analysis of the TGM has been performed in terms of the alge- 
braic multigrid theory developed by Ruge and Stiiben [21j . 

Here, the aim is to provide general conditions under which the proposed MGM 
results to be optimally convergent with a convergence rate independent of the di- 
mension and to perform the corresponding theoretical analysis. 
More precisely, for MGM we mean the simplest (and less expensive) version of the 
large family of multigrid methods, i.e. the V-cycle procedure. For a brief descrip- 
tion of the TGM and of the MGM (standard V-cycle) we refer to S}2j An extensive 
treatment can be found in [11] , and especially in [28] . 

In all the considered cases the MGM results to be optimal in the sense of Defi- 
nition 11.11 i.e. the problem of solving a linear system with coefficient matrix A m 
is asymptotically of the same cost as the direct problem of multiplying A m by a 
vector. 

Definition 1.1. [3] Let {A m x m — b m } be a given sequence of linear systems of 
increasing dimensions. An iterative method is optimal if 

1. the arithmetic cost of each iteration is at most proportional to the complexity 
of a matrix vector product with matrix A m , 

2. the number of iterations for reaching the solution within a fixed accuracy can 
be bounded from above by a constant independent of m. 

In fact, the total cost of the proposed MGM will be of 0(m) operations since for 
any coarse level s we can find a projection operator such that 

• the matrix vector product involving P s s +1 costs 0(m s ) operations where m s — 

m/2 s ; 

• the coarse grid matrix A ms+1 = Ps +1 A ms (P^ +1 ) T is also a matrix in the 
DCT III algebra generated by a polynomial symbol and can be formed within 
0(m s ) operations; 

• the convergence rate of the MGM is independent of m. 

The paper is organized as follows. In <j2]we briefly report the main tools re- 
garding to the convergence theory of algebraic multigrid methods [2T] . In we 
consider the TGM for matrices belonging to DCT-III algebra with reference to 
some optimal convergence properties, while 331 is devoted to the convergence anal- 
ysis of its natural extension as V-cycle. In f]5] numerical evidences of the claimed 
results are discussed and <J5] deals with complexity issues and conclusions. 
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2. Two-grid and Multi-grid methods 

In this section we briefly report the main results pertaining to the convergence 
theory of algebraic multigrid methods. 

Let us consider the generic linear system A m x m = b m , where A m £ C"ix™ is a 
Hermitian positive definite matrix and x m , b m £ C m . Let mo = m > mi > . . . > 
m s > . . . > m Smin and let € C ra '+ lXm< be a given full-rank matrix for any 

s. Lastly, let us denote by V s a class of iterative methods for linear systems of 
dimension m s . 

According to pj], the algebraic Two-Grid Method (TGM) is an iterative method 
whose generic step is defined as follow. 



*r = v^rc(4 n ) 



Pre-smoothing iterations 



r s = A sX p ic - b s 

r s +i = P s s +1 r s 
A s+ \ = P^ +1 A S (P^ +1 ) 
Solve A s+ iy s+ i = r s+ i 
x s = xf ° - (P* +1 ) H y s+1 



Exact Coarse Grid Correction 



T out _ -y^poat /- \ 



Post-smoothing iterations 



where the dimension m s is denoted in short by the subscript s. 
In the first and last steps a pre-smoothing iteration and a post-smoothing iteration 
are respectively applied v plc times and ^ pos t times, according to the chosen iterative 
method in the class V s . Moreover, the intermediate steps define the so called exact 
coarse grid correction operator, that depends on the considered projector operator 
P s s +1 . The global iteration matrix of the TGM is then given by 



TGM S 
CGC* 



t/ v p™> cnc i/v« 

1 s,post ( -' , - Tl ~'s ''s.preJ 



s+1 



_ x a s a s+1 = p s s +1 a s (p: +1 ) h , 



(2.1) 
(2.2) 



where V^ iPre and V S;POS t respectively denote the pre-smoothing and post-smoothing 



iteration matrices. 
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By means of a recursive procedure, the TGM gives rise to a Multi-Grid 
Method (MGM): the standard V-cycle is defined as follows. 

x° ut = MGM(s,xf,b a ) 

if s < Smin then 



Solve A s x° ut = b s 



else 



r s = A sX p/ c - b s 
r s +i = P! + i r s 

y s+ i = MQM{s + l,O s+ i,r s+ i) 

x s = xf e - (P s s +1 ) H y s +i 



x° ut — V S p OSt (i s ) 



Exact solution 



Pre-smoothing iterations 



Coarse Grid Correction 



Post-smoothing iterations 



Notice that in MGM the matrices A s+ i — P^ +1 A S (P^ +1 ) H are more profitably 
formed in the so called setup phase in order to reduce the computational costs. 
The global iteration matrix of the MGM can be recursively defined as 

MGM Stain = OeC s - xs »» 

MGM S = V£™: t [I s - (P S S +1 ) H (I s+1 - MGM S+1 ) A;^P S S +1 A S ] V%&, 

S Smin 1, . . . , 0. 



Some general conditions that ensure the convergence of an algebraic TGM 
and MGM are due to Ruge and Stiiben [2T] . 

Hereafter, by || • H2 we denote the Euclidean norm on C m and the associated induced 
matrix norm over C mXTO . If X is positive definite, || • \\x = ||^ 1//2 • H2 denotes the 
Euclidean norm weighted by X on C m and the associated induced matrix norm. 
Finally, if X and Y are Hcrmitian matrices, then the notation X < Y means that 
Y — X is nonnegative definite. 

Theorem 2.1 (TGM convergence [21]). Let niQ, mi be integers such that vtlq > 
mi > 0, let A £ C m ° xm ° be a positive definite matrix. Let Vq be a class of iterative 
methods for linear systems of dimension m and let P® € C miXm ° be a given full- 
rank matrix. Suppose that there exist a prc > and a post > independent of m 
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such that 

\\Vo, pTe x\\ A < \\x\\ 2 A - a P re||Vo,pre^||ii3-i^ for any x e C m ° (2.3a) 

II Vb, P ost x\\ 2 A < \\x\\ 2 A - a post llaFll^/j-a^ for any x <E C m ° (2.3b) 

( where D denotes the main diagonal of A) and that there exists 7 > independent 
of mo such that 



Then, 7 > a pos t and 



min ||a;- {P°) H y\\ 2 D < j\\x\\ 2 A foranyx£C m °. (2.4) 

y£C m i 



\\TGM \\ A < J \ (2.5) 

It is worth stressing that in Theorem 12. II the matrix D e C™ l ° xm ° can be substi- 
tuted by any Hermitian positive definite matrix X: clearly the choice X = I can 
give rise to valuable simplifications [T]. 

At first sight, the MGM convergence requirements are more severe since the 
smoothing and CGC iteration matrices are linked in the same inequalities as stated 
below. 

Theorem 2.2 (MGM convergence [H]). Let mo = m > mi > m-z > . . . > m s > 

. . . > m Smia and let A e C mxm be a positive definite matrix. Let P s s +1 € £m s+1 xm s 
be full-rank matrices for any level s. Suppose that there exist 5 pre > and S pos t > 
such that 

\\V s u ^%xf Aa < \\xf Aa - 5 pre \\CGC s V s %%xf As for any x e £ m » (2.6a) 
\\V^x\\ 2 Aa < \\xf As ~ S post \\CGC s x\\ Aa foranyxeC m ° (2.6b) 

both for each s = 0, . . . , s mln — I, then d post < 1 and 



1 — <5post 



l|MGMoll ^V^v <L (27) 

By virtue of Theorem l2.2[ the sequence {im j^N will converge to the solution of 
the linear system A m x m — b m and within a constant error reduction not depending 
on m and s m i n if at least one between S pre and S pos t is independent of m and s m i n - 
Nevertheless, as also suggested in [21], the inequalities (I2.6a[) and (|2.6b|) can 
be respectively splitted as 

||V^ r r ex||^ s < \\x\\ Aa - a \\Vs,pT%x\\ AeD -i As 
\\CGC s xf At <7lklll^-A s (2-8) 

5pre = a/7 

iKpost^lU, - W X W 2 A S - I 3 \\ x \\a b D7 1 A s 

\CGC s xf As <l\\xf AtD -i Ae (2.9) 

/post = Ph 



and 



G 
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where D s is the diagonal part of A s (again, the AD~ l A-norm is not compulsory [T] 
and the A 2 -norm will be considered in the following) and where, more importantly, 
the coefficients a, (3 and 7 can differ in each recursion level s since the step from 
(|2.8|) to (|2.6a|) and from (|2.9|) to (|2.6b|) are purely algebraic and do not affect the 
proof of Theorem 12.21 

Therefore, in order to prove the V-cycle optimal convergence, it is possible to 
consider the inequalities 

ll^rc^ll^ < IMll ~ «. \\V^ c x\\ 2 Al for any x e (2.10a) 

\K; p o^f As ^ \\ x \\a. - & Nft; fOT an y * e C m = (2.10b) 

||CGC,as||^ < 7 S \\xf Aa for any x e C" ls . (2.10c) 

where it is required that a s , j3 s , 7 S > for each s = 0, . . . , s m in ~ 1 and 

<5 prc = min — , S post = min — . (2-11) 

0<s<s min 7 S 0<s<s min 7 S 

We refer to Q2.10a|) as the pre- smoothing property, (|2. 10b[) as the post- smoothing 
property and (|2.10c|) as the approximation property (see |21|). 
An evident benefit in considering the inequalities (|2. 10a|l - (|2. 10c|) relics on to the 
fact that the analysis of the smoothing iterations is distinguished from the more 
difficult analysis of the projector operator. 

Moreover, the MGM smoothing properties (|2.10a|) and (|2. 10b|) are nothing more 
than the TGM smoothing properties (|2.3ap and (|2.3b[) with D substituted by /, 
in accordance with the previous reasoning (see [1]). 



3. Two-grid and Multi-grid methods for DCT III matrices 



Let C m — {C m G 



I C m = QmDmQm} the unilevel DCT-III cosine matrix 



algebra, i.e. the algebra of matrices that are simultaneously diagonalized by the 
orthogonal transform 



2 - 6 j} i 



cos 



(i-l)(j-l/2)7T 



rn. 



(3.1) 



with 5ij denoting the Kronecker symbol. 

Let / be a real-valued even trigonometric polynomial of degree k and period 2-7T. 
Then, the DCT III matrix of order m generated by / is defined as 

D m (f) = dia gl <,< m / (iW) , xf 1 = 



Cm{f) = QmD m {f)Q 



T 
m ' 



Clearly, C m (f) is a symmetric band matrix of bandwidth 2k + 1. In the following, 
we denote in short with C s — C m3 (g s ) the DCT III matrix of size m s generated 
by the function g s . 

An algebraic TGM/MGM method for (multilevel) DCT III matrices generated by 
a real- valued even trigonometric polynomial has been proposed in [7]. Here, we 
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briefly report the relevant results with respect to TGM convergence analysis, the 
aim being to prove in Sj3]the V-cycle optimal convergence under suitable conditions. 
Indeed, the projector operator P s s +1 is chosen as 

where T£ +l G W ns + lXm " , m s+ i = m s /2, is the cutting operator defined as 

l/y/2 for j G {2i - 1, 2i}, i = 1, . . . , m s+1 , 
otherwise. 



(3.2) 



and C s (p s ) is the DCT-III cosine matrix of size m s generated by a suitable even 
trigonometric polynomial p s . 

Here, the scaling by a factor l/v2 is introduced in order to normalize the matrix 
T^ +1 with respect to the Euclidean norm. From the point of view of an algebraic 
multigrid this is a natural choice, while in a geometric multigrid it is more natural 
to consider just a scaling by 1/2 in the projector, to obtain an average value. 
The cutting operator plays a leading role in preserving both the structural and 
spectral properties of the projected matrix C s +i: in fact, it ensures a spectral link 
between the space of the frequencies of size m s and the corresponding space of 
frequencies of size m s +i, according to the following Lemma. 



Lemma 3.1. 7J Let Q s G 

respectively. Then 



and T s s +1 G 



jm 3 , i xm s 



be given as in (13. ip and 



T° +1 Q S — Q s+1 [$ s+ i, 8 s+1 n s+ i], 



whe 



diag 



6 s+ i = diag j=li „ is+i 
and II s+ i G 




,] _ (j - 1 ) 7r 



(3.3) 

(3.4a) 
(3.4b) 



jm J+ ixm, + i j s ^ e p ermu i a a on matrix 

(1,2, . . . ,m s+ i) i * (1,to s+ i,to s+ i - 2, ... ,2). 
As a consequence, let A s = C s (f s ) be the DCT-III matrix generated by f S) then 
A s +i = Ps+iA s (Ps +1 ) T = C s+ i(/ s+ i) 



whe 



fs+l(x) 



cos 



x/2 
~2~ 



/.(I)rf(f) 

(^)/.(-I)^(-f). 

On the other side, the convergence of proposed TGM at size m s is ensured 
by choosing the polynomial as follows. 



+ cos' 
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Definition 3.2. Let x° e [0, tt) a zero of the generating function f s . The polynomial 
p s is chosen so that 

lim p2 ^~ x) < +oo, (3.6a) 

x->x° f s {X) 

p 2 s (x)+p 2 s (ir-x)>0. (3.6b) 
In the special case a; = tt, the requirement (|3.6ap is replaced by 

lim -P^—^—<+oo. (3.7a) 

s-s°=7T COS 2 (f) f s (x) 

If f s has more than one zero in [0, n] , then p s will be the product of the polynomials 
satisfying the condition (|3.6a[) (or (|3.7ap ) for every single zero and globally the 
condition (|3.6b[) . 

It is evident from the quoted definition that the polynomial p s must have 
zeros of proper order in any mirror point x° = tt — x° , where x° is a zeros of f s . 
It is worth stressing that conditions (|3.6ap and (|3.6b|) are in perfect agreement with 
the case of other structures such as t, symmetric Toeplitz and circulant matrices 
(see e.g. E2JE2]), while the condition (|3.7a|l is proper of the DCT III algebra and 
it corresponds to a worsening of the convergence requirements. 
Moreover, as just suggested in [7], in the case x° — the condition (|3.6ap can also 
be weakened as 

cos 2 (2=2) p 2 s (n-x) 
lim 1 V/ x " < +°°- 3 - 8a 

We note that if f s is a trigonometric polynomial of degree k, then f s can have a 
zero of order at most 2k. If none of the root of f s are at tt, then by (|3.6ap the 
degree of p s has to be less than or equal to [~fc/2~|. If tt is one of the roots of f s , 
then the degree of p s is less than or equal to \{k + 1) /2] . 

Notice also that from (|3 . 5(1 . it is easy to obtain the Fourier coefficients of / s+ i and 
hence the nonzero entries of A s+ i = C s +i(/ s +i). In addition, we can obtain the 
roots of /s+i and their orders by knowing the roots of f s and their orders. 

Lemma 3.3. [7] If < x° < tt/2 is a zero of f s , then by (|3.6ap . p s (ir — x a ) = 
and hence by (|3.5p . / s +i(2a; ) = 0, i.e. y° = 2x° is a zero of f s +i- Furthermore, 
because p s (n — x ) = 0, by (I3.6b[) . p s (x°) > and hence the orders of x° and y° 
are the same. Similarly, ir/2 < x° < ir, then y° — 2(ir — x ) is a root o// s +i with 
the same order as x° . Finally, if x° = ir, then y - - with order equals to the 
order of x° plus two. 

In [7] the Richardson method has be considered as the most natural choice 
for the smoothing iteration, since the corresponding iteration matrix V m := I m — 
u)A m € C mxm belongs to the DCT-III algebra, too. Further remarks about such 
a type of smoothing iterations and the tuning of the parameter u> are reported in 

ESI El. 
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Theorem 3.4. [7 Let A ma = C ma (fo) with f$ being a nonnegative trigonometric 
polynomial and let V mo = I m „ - uoA mQ with u> = 2/||/ ||oo and u = l/||/o||oo, 
respectively for the pre-smoothing and the post-smoothing iteration. Then, under 
the quoted assumptions and definitions the inequalities ()2.3a[) . (|2.3b[) . and (12. 4|) 
hold true and the proposed TGM converges linearly. 

Here, it could be interesting to come back to some key steps in the proof of 
the quoted Theorem 13.41 in order to highlight the structure with respect to any 
point and its mirror point according to the considered notations. 
By referring to a proof technique developed in [55] , the claimed thesis is obtained 
by proving that the right-hand sides in the inequalities 



7> 



1 



> 



d s (x) 
1 



cos 



COS 



7T — x\ Ps(7T — x) 



7T — x\ pl(TT — X) 



da (as) 
d a (x) = cos 2 



fs(x) 
7T — X 



COS 



x\ p 2 s (x) 



>,(X\ _Ps_ 

\2) fJn 



/»(tt - x) 



P 2 s (tt~x) 



(3.9a) 
(3.9b) 
(3.9c) 



are uniformly bounded on the whole domain so that 7 is an universal constant. 
It is evident that (|3.9a[) is implied by (|3.9b[) . Moreover, both the two terms in 
(|3.9b|) and in d s (x) can be exchanged each other, up to the change of variable 
y = 7T — x. 

Therefore, if x° 7^ ir it is evident that Definition 13.21 ensures the required uniform 
boundedness since the condition p 2 s {x) + pi {jr — x) > implies d s (x) > 0. 
In the case x° = w, the inequality (|3.9b[) can be rewritten as 



7 



> 



1 



,2 ( 7T-X N 



COS 2 (f ) 



p 2 (?r - x) 



P 2 s(x) 



cos- 



■(f) /a (Z) COS 2 (^) f s (7T-x) 



(3.10) 



so motivating the special case in Definition E 



4. V-cycle optimal convergence 

In this section we propose a suitable modification of Definition 13.21 with respect to 
the choice of the polynomial involved into the projector, that allows us to prove 
the V-cycle optimal convergence according to the verification of the inequalities 
(|2.10aj) - (|2.10cp and the requirement (|2~TTj) . 

It is worth stressing that the MGM smoothing properties do not require a true 
verification, since (|2.10ap and (|2.10bj) are exactly the TGM smoothing properties 
(pE3a|) and (f2~3b"l) (with D = I). 

Proposition 4.1. Let A s = C TOs (/ s ) for any s = 0, . . . , s m [ n , with f s > 0, and 
let lo s be such that < w s < 2/H/gHoo. If we choose a s and f3 s such that a s < 
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cj s min{2,(2-w s ||/ ;5 || 00 )/(l-cj s ||/ s || 00 ) 2 } and [3 S < £J S (2 - WgH/gHoo) then for 
any x € C™ 1 the inequalities 

\\V s<pxe xf As < \\x\\ As -a s \\V s , pre x\\ Aa (4.1) 
\\V s<post xf As < \\x\\ 2 Aa -(3 s \\x\\ 2 As (4.2) 

hold true. 

Notice, for instance, that the best bound to f3 s is given by l/||/ s ||oo and it is 
obtained by taking tu s = l/||/ s ||oo [23112^. 

Concerning the analysis of the approximation condition (|2.10c[) we consider 
here the case of a generating function /o with a single zero at a; . In such a case, 
the choice of the polynomial in the projector is more severe with respect to the 
case of TGM. 

Definition 4.2. Let x° € [0, ir) a zero of the generating function f s . The polynomial 
p s is chosen in such a way that 

lim PS ^~. X) < +oo, (4.3a) 

x^x° f s (x) 

P 2 s (x)+ P 2 s (tt-x)>0. (4.3b) 
In the special case a; = ir, the requirement (|4.3a[) is replaced by 

z->x°=tt COS (f J f s {X) 

Notice also that in the special case x° = the requirement (|4.3a[) can be weakened 
as 

lim COS ^) r P f- X) < + oc. (4.5a) 

Proposition 4.3. Let A s = C ms (f s ) for any s — 0, . . . , s m ; n , with f s > 0. Let 
P« +1 = T* +1 C s (p s ), where p s (x) is fulfilling (|4~3aj) (or (gja|) ) and g^H). Then, 
for any s = 0, . . . , s m i n — 1, there exists 7 S > independent of m s such that 

\\CGC s x\\ As < 7s ||as||= ; for any x G C"\ (4.6) 

where CGC S is defined as in ()2.2|) . 

Proof. Since 

CGC S = J s - (P^^+^P^fr 1 ^^ 

is an unitary projector, it holds that CGCf A s CGC S = A 8 CGC S . Therefore, the 
target inequality (|4.6[) can be simplified and symmetrized, giving rise to the matrix 
inequality 

CGC S =I S - Al'\P! +1 ) T {P! +1 A s {P! +1 ) T )^P! +1 A\l 2 < ls A s . (4.7) 
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Hence, by invoking Lemma T3.ll Q^CGC S Q S can be permuted into a 2 x 2 block 
diagonal matrix whose jth block, j — 1, . . . , m s +i, is given by the rank-1 matrix 
(see [5] for the analogous r case) 



h 



Cj Sj Sj 



where 



cos 



2 r I [m,]> 

P /(tt - x) I) 



As in the proof of the TGM convergence, due to the continuity of f s and p s , (|4.7|) 
is proven if the right-hand sides in the inequalities 



> 



1 



> 



d s (x) 
1 



d s (x) 
d s (x) — cos 2 



cos 



K ~ x\ p 2 /s(7T - X) 



fs(x) 



COS' 



X\ P 2 s fs(x) 



(x\ p%]_ 
\2) Utt 



fsfr - x) 



cos 



(4.8a) 
(4.8b) 
(4.8c) 



are uniformly bounded on the whole domain so that 7 S are universal constants. 
Once again, it is evident that (|4.8aj) is implied by (I4.8bj) . Moreover, both the terms 
in (|4.8bp and in d s (x) can be exchanged each other, up to the change of variable 
y = it — x. 

Therefore, if x° ^ tt, (f4~8b|) can be rewritten as 



7, > 



d s (x) 



TT — x\ P 2 s {tT — x) 



^2) PAtt 



P 2 s (x) 



where 



d s (x) = cos z - 



P 2 s{x) 



cos 



fK^-x) 



TT — X \ p 2 s (TT — X) 



(4.9) 



fs(x) 



■2J f.fr-x) 

so that Definition 14.21 ensures the required uniform boundedness. 
In the case a; = tt, the inequality (|4.8b[) can be rewritten as 



> 



re (a) 



(^)f s (n-x) 



3S 2 (f ) fs(x) 



P 2 s {tt - x) 



cos z 



P 2 s {x) 



so motivating the special case in Definition 14.21 



(4.10) 
□ 
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Remark 4.4. Notice that in the case of pre-smoothing iterations and under the 
assumption V^. plc nonsingular, the approximation condition 

\\CGC a V^xf At < ls \\V s y° e xf Ai for any x G C m >, (4.11) 

is equivalent to the condition, in matrix form, CGC S < 7s A s obtained in Propo- 
sition 14.31 

In Propositions 14.11 and 14.31 we have obtained that for every s (independent 
of m = too) the constants a s , f3 s , and 7 S are absolute values not depending on 
to = too, but only depending on the functions f s and p s . Nevertheless, in order to 
prove the MGM optimal convergence according to Theorem 12.21 we should verify 
at least one between the following inf-min conditions [1]: 

Sprc = inf min — > 0, S post = inf min — > 0. (4-12) 

m 0<s<log 2 (m ) 7 S mo 0<s<log 2 (m ) 7 S 

First, we consider the inf-min requirement (|4.12|) by analyzing the case of a gen- 
erating function / with a single zero at a; = 0. 

It is worth stressing that in such a case the DCT-III matrix A mg = C mQ (/o) is sin- 
gular since belongs to the set of grid points a^" 10 ' = (j — l)7r/mo, j = 1, . . . , too. 
Thus, the matrix A mQ is replaced by 

A mo = Cm (/o) = Cra (/o) + fo I ^2™° ) ' 

v / too 

with e — [1, . . . , 1] T <E M m ° and where the rank-1 additional term is known as 
Strang correction [29) . Equivalently, /o > is replaced by the generating function 

/o = /o + /o(4 mol )^ +2 .z> ' ( 4 - 13 ) 

where Xx is the characteristic function of the set X and u>[ m °' — x° = 0. 
In Lemma l4~5l is reported the law to which the generating functions are subjected at 
the coarser levels. With respect to this target, it is useful to consider the following 
factorization result: let /> be a trigonometric polynomial with a single zero at 
x° of order 2q. Then, there exists a positive trigonometric polynomial ip such that 

f{x) = [1 - cos{x - x )] q ip(x). (4.14) 

Notice also that, according to Lemma [3~3l the location of the zero is never shifted 
at the subsequent levels. 

Lemma 4.5. Let f (x) = f Q (x) + c X 2 -kI,(x), with f Q (x) = [1 - cos^fi/'o^), q 
being a positive integer and ipg being a positive trigonometric polynomial and with 

c o = /o ^2™°') • Let p s (x) — [1 -I- cos(a;)] 9 for any s = 0, . . . , s m j n — 1. Then, under 
the same assumptions of Lemma \3.1[ each generating function f s is given by 

f s (x) = f s (x) + c s X2kz{x), f s {x) = [1 - co$,(x)] q il; s (x). 
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The sequences {ip s } cind {c s } are defined as 

1ps+l=®q,p 3 (ll>s), C s+ l = C s pl(0), S = 0, . . . , S mi „ - 1, 

where Q q , p is an operator such that 

0*0 = [(VP^) (|) + ~ f )] . ( 4 - 15 ) 

with ip(x) = 1 + cos(a^). Moreover, each f s is a trigonometric polynomial that 
vanishes only at 2tt1 with the same order 2q as /q. 

Proof. The claim is a direct consequence of Lemma l3.il Moreover, since the func- 
tion ipo is positive by assumption, the same holds true for each function ip s . □ 

Hereafter, we make use of the following notations: for a given function /, we 
will write Mf = swp x |/|, m/ = inf^ |/| and Hoo(f) = M//m/. 
Now, if x € (0, 2tt) we can give an upper bound for the left-hand side R(x) in 
(14.91). since it holds that 



\p 2 s (x) cos 2 p 2 s (w - x) 



R{x) 



3S 2 (§)p 2 (a;) cos 2 ( 2 -j £ ) p 2 ("" — x) 



cos 



2 (!) , cos 2 (=5=) 



^I(tt-x) V 2 (a:) 



COS 2 (2^2) p s (x) COS 2 p s (7T 



-0 s (7r-a;) Vs(a;) 



< 



< 



2 



^ s cos 2 (f ) p s (x) + cos 2 (2^) p s (7T - x) 

M,i,„ 



we can consider 7 S = M^Jm^. In the case x = 0, since p s (0) = 0, it holds 
i?(0) = 1// s (tt), so that we have also to require 1/ f s (ir) < j s . However, since 
1// s (tt) < M^/m 2 ^, we take 7* = M^/m 2 ^ as the best value. 
In (JZU), by choosing = \\f.\\£, we simply find # = \\f B \\£ > l/(2«Afy.) and 
as a consequence, we obtain 

^>^.<^ 1 . (4.16) 

A similar relation can be found in the case of a pre-smoothing iteration. Neverthe- 
less, since it is enough to prove one between the inf-min conditions, we focus our at- 
tention on condition (|4.16[) . So, to enforce the inf-min condition (14.12[) . it is enough 
to prove the existence of an absolute constant L such that /ioo(V's) ^ L < +00 
uniformly in order to deduce that ||MGM || A < y/l — (2iL 2 )^ 1 < 1. 
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Proposition 4.6. Under the same assumptions of Lemma 14.51 let us define ip s — 
[$ Ps . g ] s ('0) for every s£N, where is the linear operator defined as in (|4.15p . 
Then, there exists a positive polynomial ip^ of degree q such that ip s uniformly 
converges to ipoo, and moreover there exists a positive real number L such that 
food's) < L for any s G N. 

Proof. Due to the periodicity and to the cosine expansions of all the involved 
functions, the operator P in (|4.15p can be rewritten as 

[%.,pW] (*) - [(VP*) (|) + (* + f )] • (4.17) 

The representation of $ 9iP in the Fourier basis (see Proposition 4.8 in pQ) leads 
to an operator from W 71 ^ to R m ''', m(q) proper constant depending only on q, 
which is identical to the irreducible nonnegative matrix <5> q in equation (4.14) of 
[1], with q + 1 in place of q. 

As a consequence, the claimed thesis follows by referring to the Perron-Frobenius 
theorem [15, 30 according to the very same proof technique considered in pQ. □ 

Lastly, by taking into account all the previous results, we can claim the 
optimality of the proposed MGM. 

Theorem 4.7. Let fo be a even nonnegative trigonometric polynomial vanishing at 
with order 2q. Let mo = m > mi > . . . > m s > . . . > m Smin , m s+ i = m s /2. For 
any s = 0, . . . , Tn Smin — 1, let Pg + i be as in Proposition ^.!^ with p s (x) — [l+cos(x)] 9 , 
and let V StPost = I m , - A ms /\\f 3 \\ o- If we set A mo = C m „(f + c X 2t z) with 
c o = fo( w 2 n °^) an d we consider b € C m °, then the MGM (standard V- cycle) 
converges to the solution of A mo x — b and is optimal (in the sense of Definition 

li~Tj). 

Proof. Under the quoted assumptions it holds that fo(x) = [1 — cos(a;)] 9 tpo(x) 
for some positive polynomial tpo{x). Therefore, it is enough to observe that the 
optimal convergence of MGM as stated in Theorem 12.21 is implied by the inf-min 
condition (|4.12j) . Thanks to (|4. 16|) . the latter is guaranteed if the quantities /J,oo(tps) 
are uniformly bounded and this holds true according to Proposition 14.61 □ 



Now, we consider the case of a generating function fo with a unique zero at 
x = it, this being particularly important in applications since the discretization 
of certain integral equations leads to matrices belonging to this class. For instance, 
the signal restoration leads to the case of /o(tt) = 0, while for the super-resolution 
problem and image restoration /o( 7r I 7r ) = is found [5]. 

By virtue of Lemma 13.31 we simply have that the generating function f\ related 
to the first projected matrix uniquely vanishes at 0, i.e. at the first level the 
MGM projects a discretized integral problem, into another which is spectrally and 
structurally equivalent to a discretized differential problem. 

With respect to the optimal convergence, we have that Theorem 12.21 holds true 
with S = minj^o,^} since 5 results to be a constant and independent of mo- 
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More precisely, So is directly related to the finest level and S is given by the 
inf-min condition of the differential problem obtained at the coarser levels. The 
latter constant value has been previously shown, while the former can be proven as 
follows: we are dealing with fo(x) = (l + cos(x)) q ipo(x) and according to Definition 
14.21 we choose po(x) = Pq{x) + doX2nZ with po(x) = (1 + cos(a;)) 9+1 and d — 

i [mo]\ 

Therefore, an upper bound for the left-hand side R(x) in (|4.10[) is obtained as 

i.e. we can consider 70 = M^/m^ and so that a value 5o independent of too is 
found. 



5. Numerical experiments 

Hereafter, we give numerical evidence of the convergence properties claimed in 
the previous sections, both in the case of proposed TGM and MGM (standard 
V-cycle), for two types of DCT-III systems with generating functions having zero 
at (differential like problems) and at it (integral like problems). 
The projectors P s s +1 are chosen as described in Sj3]in Sjjjand the Richardson smooth- 
ing iterations are used twice in each iteration with ui = 2/||/|| and u> — 1/||/| 
respectively. The iterative procedure is performed until the Euclidean norm of the 
relative residual at dimension too is greater than 10 -7 . Moreover, in the V-cycle, 
the exact solution of the system is found by a direct solver when the coarse grid 
dimension equals to 16 (16 2 in the additional two-level tests). 

5.1. Case x° = (differential like problems) 

First, we consider the case A m — C m (/o) with fo(x) = [2 — 2cos(x)] 9 , i.e. with a 
unique zero at x° = of order 2q. 

As previously outlined, the matrix C m (/o) is singular, so that the solution of 
the rank-1 corrected system is considered, whose matrix is given by C m (/o) + 
(f (ir/m)/m)ee T , with e = [1, . .., 1] T . Since the position of the zero a; = at the 
coarser levels is never shifted, then the function p s {x) = [2 — 2 cos(7r — x)] r in the 
projectors is the same at all the subsequent levels s. 

To test TGM/MGM linear convergence with rate independent of the size too we 
tried for different r: according to (|3.6aj) . we must choose r at least equal to 1 if 
5 = 1 and at least equal to 2 if q = 2, 3, while according to (|4.3al> we must always 
choose r equal to q. The results are reported in Table [T] 

By using tensor arguments, the previous results plainly extend to the multilevel 
case. In Table [2] we consider the case of generating function f (x,y) = fo(x) + 
/o(y)j that arises in the uniform finite difference discretization of elliptic constant 
coefficient differential equations on a square with Neumann boundary conditions, 
see e.g [2"4"] . 
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Table 1. Twogrid/Multigrid - ID Case: f {x) = [2 - 2cos(a;)] 9 
and p(x) — [2 — 2 cos(7r — x)] r . 



TGM 




MGM 




q = l 


9 = 


= 2 


9 = 


= 3 






9 = 1 


9 = 


= 2 


9 = 


= 3 


m 


r = 1 


r = 1 


r = 2 


r = 2 


r = 3 




m 


r = 1 


r = 1 


r = 2 


r = 2 


r = 3 


16 


7 


15 


13 


34 


32 




16 


1 


1 


1 


1 


1 


32 


7 


16 


15 


35 


34 




32 


7 


16 


15 


34 


32 


64 


7 


16 


16 


35 


35 




64 


7 


17 


16 


35 


34 


128 


7 


16 


16 


35 


35 




128 


7 


18 


16 


35 


35 


256 


7 


16 


16 


35 


35 




256 


7 


18 


16 


35 


35 


512 


7 


16 


16 


35 


35 




512 


7 


18 


16 


35 


35 




Table 2. 


Twogrid/Multigrid 




2D 


Case: 


fo(x, y) = 


[2 - 





2cos(x)]« + [2 - 2cos(y)]« and p(x,y) = [2 - 2cos(tt - a;)] r + 
[2-2cos(7r-y)] r . 



TGM 




MGM 




9 = 1 


9 = 


= 2 


9 = 


= 3 






9 = 1 


9 = 


= 2 


9 = 


= 3 


m () 


r = 1 


r = 1 


r = 2 


r = 2 


r = 3 




mo 


r = 1 


r = 1 


r = 2 


r = 2 


r = 3 


16 y 


15 


34 


30 








16 2 


1 


1 


1 


1 


1 


32 2 


16 


36 


35 


71 


67 




32 2 


16 


36 


35 


71 


67 


64 2 


16 


36 


36 


74 


73 




64 2 


16 


36 


36 


74 


73 


128 2 


16 


36 


36 


74 


73 




128 2 


16 


36 


36 


74 


73 


256 2 


16 


36 


36 


74 


73 




256 2 


16 


37 


36 


74 


73 


512 2 


16 


36 


36 


74 


73 




512 2 


16 


37 


36 


74 


73 



5.2. Case x° = tt (integral like problems) 

DCT III matrices A mo = C mo (/o) whose generating function shows a unique zero 
at x° — 7r are encountered in solving integral equations, for instance in image 
restoration problems with Neumann (reflecting) boundary conditions [18] . 
According to Lemma 13.31 if x° = tt, then the generating function fi of the coarser 
matrix A mi = C TOl (/i), mi = mo/2 has a unique zero at 0, whose order equals 
the order of x° = tt with respect to fo plus two. 

It is worth stressing that in such a case the projector at the first level is singular so 

that its rank-1 Strang correction is considered. This choice gives rise in a natural 

way to the rank-1 correction considered in §5.11 Moreover, starting from the second 

coarser level, the new location of the zero is never shifted from 0. 

In Table [3] are reported the numerical results both in the unilevel and two-level 

case. 

6. Computational costs and conclusions 

Some remarks about the computational costs are required in order to highlight 
the optimality of the proposed procedure. 
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Table 3. Twogrid/Multigrid - ID Case: f (x) = 2 + 2cos(x) and 
Po(x) — 2 — 2cos(7r — x) and 2D Case: fo(x,y) = 4 + 2cos(a:) + 
2 cos(y) and po (x, y) = 4 — 2 cos(7r — cc) — 2 cos(7r — y). 



ID 


TGM 


MGM 




2D 


TGM 


MGM 


16 


15 


1 




16 y 


7 


1 


32 


14 


14 




32 2 


7 


7 


64 


12 


13 




64 2 


7 


7 


128 


11 


13 




128 2 


7 


6 


256 


10 


12 




256 2 


7 


6 


512 


8 


10 




512 2 


7 


6 



Since the matrix C ma (p) appearing in the definition of -P/ +1 is banded, the cost 
of a matrix vector product involving Pg + i is 0(m s ). Therefore, the first condition 
in Definition 11.11 is satisfied. In addition, notice that the matrices at every level 
(except for the coarsest) are never formed since we need only to store the O(l) 
nonzero Fourier coefficients of the related generating function at each level for 
matrix-vector multiplications. Thus, the memory requirements are also very low. 
With respect to the second condition in Definition 11.11 we stress that the repre- 
sentation of A ms+1 — C TOs+1 (/ s +i) can be obtained formally in O(l) operations 
by virtue of (|3.5p . In addition, the roots of / s +i and their orders are obtained 
according to Lemma 13.31 by knowing the roots of f s and their orders. Finally, each 
iteration of TGM costs 0(itiq) operations as A mo is banded. In conclusion, each 
iteration of the proposed TGM requires O(too) operations. 

With regard to MGM, optimality is reached since we have proven that there exists 
S is independent from both m and s min so that the number of required iterations 
results uniformly bounded by a constant irrespective of the problem size. In addi- 
tion, since each iteration has a computational cost proportional to matrix-vector 
product, Definition 11.11 states that such a kind of MGM is optimal. 

As a conclusion, we observe that the reported numerical tests in $5]show that 
the requirements on the order of zero in the projector could be weakened. Future 
works will deals with this topic and with the extension of the convergence analysis 
in the case of a general location of the zeros of the generating function. 
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